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Abstract 

A deformed logarithm function called g-logarithm has received considerable 
attention by physicist after its introduction by C. Tsallis. J. Naudts has 
proposed a generalization called 0-logarithm and he has derived the basic 
properties of 0-exponential families. In this paper we study the related notion 
of marginal polytope in the case of a finite state space. 
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1. Introduction 



In Sec. [2] we review the basic pr o pertie s of deformed exponential fam- 
ilies as they are discussed in iNaudtsI ( 120111 ). We do not give here detailed 
references and refer to the bibliographical notes in this monograp h. Th e 



presen tation of exponential families we use is non-parametric as in [Pistone 
( 120091 ). In Sec. [3] we give our ge neraliza t ion o f the notion of marginal poly- 
tope. The standard version is in iBrownl ( 1l986l ). 



2. Background 

The deformed expon ential function are usually introduced starting from 



Ch. 10), with the aim to define a 
R> — )■ M> be a positive, increasing. 



the logarithm, see e.g. iNaudtd (12011 
generalization of the entropy. Let < 
absolutely continuous function. The (j)- logarithm is the function In^ (v) = 

dy/(f){y), V G M>, which reduces to ordinary logarithm when 0(t>) = v. 

The deformed logarithm In,^ is defined on M> and it is strictly increasing 
and concave. In the following we assume — = J^°° = +oo so 

that the range of In^ is the full real line M. 
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The (p- exponential or deformed exponential is the inverse function exp^ = 
In,^"^. It is increasing and convex and solves the differential equation y' = 
4>{y), y{0) = 1. It is convenient to introduce the rate function 

exp^ [u) 

so that we have 

exp^'(M) = 0(exp^ (m)) = exp^ (u) . 

Viceversa, given a positive absolutely continuous rate function ip: M. ^ 
]R>, such that j^^'ip{x)dx = J^^'^ ilj{x)dx = +00 and -ip' + ip"^ > 0, the 
solution of the differential equation y'{u) = ip{u)y{u), y{0) = 1, is a deformed 
exponential exp^ whose 0-function is 

(f){v) = ip{\n^{v)), veRy. 

This deformed exponential is self- dual, exp^ (u) exp^ (— "i^) = 1, if, and only 
if, the rate function ip is symmetric because 

^exp^ (u) exp^ {-u) = 

-piu) exp^ (u) exp^ {-u) - -pi-u) exp^ (u) exp^ {-u) = 

{tp{u) - tp{-u)) exp^ (u) exp^ (-n) . 



Exam ple 1 (Kaniadakis) . The deformed exponential defined in iKaniadakis 
( I2OOII ) with parameter is 

exp^ (w) = exp I /" ^=i==), ueR, Ke[0,l[. 

It has 

^P{y) = {1 + nV)-'/\ P>{x) 



x'^ + X 

Example 2 (Tsallis) . The function p{y) = y'^ does not satisfy our restrictive 
assumptions and has been used by Tsallis in 1994 to define his deformed 
logarithm. Given a symmetric function a, then p{y) = ya{y'^,y~'^) is self- 
dual. Kaniadakis' logarithm is an example, with cr{s,t) =2/{s + t~^). 
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Let (X,^) be a finite sample space with reference measure fi. We denote 
by L the vector space of real random variables on X. If p is any probability 
density of the sample space, Lo{p) denotes the vector space of p-centered 
random variable, i.e. u G L belongs to Lo(p) if Ep [u] = ^^.g^t" ~ 
0. Given a density p and random variables Hj E L, j = 1, . . . , m, the 0- 
exponential family of the statistics Hj is the parametrized set of densities 



pe{x) = exp^ [ ^9jHj{x) - a(6') j p{x), 9 e 



(1) 



where a{6) is characterized by the normalization condition. In fact, the 
function 



— a 



a^Ep exp^ ^OjHj 

is continuous and decreasing from +oo to 0, so that for each 6 G 
exists a unique value a{9) such that pe in Eq. ([1]) is a density. 



Two different sets of statistics Hj, j 



m and ifj, j = 1, 



there 



, m 



define the same statistical model if, and only if, the vector space generated 
by the centered random variables is the same. 



Span {Hj - Ep [Hj] , j 



m 



) = Span {H'^-Ep[H'^],3 



, m' 



') 



According to lPistond (|2009[ ). it is more canonical to define the ^-exponential 
model as the set of densities pu of the form 



Pu = exp^ {u - K{u))p, ueV, 



(2) 



where V = Span {Hj — Ep [Hj] , j = 1, . . . , m) is a linear sub-space of Lo{p) 
and 



K{u) 



(3) 



ie) - J2 OjK m , u = Y,03 (H, - Ep [H,]) 

The quantity K{u) is in fact the divergence of p from pu because from u — 
K{u) = In^ ^1 j , Ep [u] = 0, and the self-duality of the deformed logarithm. 



we have 



K{u) = Ep 



In^ ( - 
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The random variable m G is a unique parameterization of Pu as 



u = Iua 



In^ 



The non parametric derivative of the mapping Lq : u K{u) is obtained 
by derivation of the expected value of Eq. (|2]) in the direction v E Lq. We use 
the notation D K {u)v = -§iK(u + tv) As E^ [p^] = Ep [exp^ {u — K{u))\ 
1, we obtain 

Ep [Dexp^ {u - K{u))v\ = 

Ep [tp{u - K{u)) exp^ (n - K{u)) D (u - K{u))v] = 0. 

As we have 



ij{u - K{u)) = V; ( In,^ ( ^ 



we can write 



E, 



Pu 



Pu 

P 



Pu 



Pu 

P 



Pu 

P 



DK(u)v. 



The probability density 



P4>,u 



Er. 



Pu 



is called the escort density and we have D K (u) v = E^^u [v]- 

The second derivative of m i— )■ exp^ {u — K{u)) in the directions v and w 
is the first derivative in the direction w of u exp^' {u — K (u)) {v — D K {u)v) , 
therefore it is equal to 

exp^"(M — K{u)){v — DK{u)v){w — DK{u)w) — exp^'(u — K{u))D'^K{u)vw. 



The random variable in Eq. (jl]) has zero p-expectation, so that 
Ep [exp/(M - K{u)){y - DK{u)v){w - DK{ 



(4) 



D^K{u)vw 



UjW 



Ep [exp/(M - K{u))] 



li w = V 0, then D'^K{u)vv > 0, therefore the functional K is strictly 
convex. For m = we obtain D'^K{0)vw = CoVp{u,v). We do not have 
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a similar int erpretati o n for 7^ 0, but see the discussion of the parallel 
transport in Pistonel (2009 . sec. 4) and of conformal transformations in 
Ohara and Amaril (j201ll ). 

The convex conjugate of Lo{p): u y-^ K{u), is defined in the duality 

{u*, u) ^ Ep [u*u] by 



H{u*) = sup {Ep [u*u] - K{u) : ue Lo{p)}, u* E Lq{p). 



(5) 



The function Lq{p) 9 m i— t- Ep [u*u\ — K[u) is concave and has derivative 
in the direction v equal to 



Ep [u*v\ - E<^_„ [v] = Ep [u*v] - Ep 



P<t>,u 

. V 



If we have a maximum at u in Eq. ([5]), then u satisfies p^^u = u*p. 
For the model in Eq. ([2]) we define 

Hv{u*) = sup {Ep [u*u] - K{u) : u eV} , u* E Lo{p). 



(6) 



In this case the directional derivative has to be zero for all f G and a 
maximum at u implies that u* has orthogonal projection on V equal to that 

of P<f>,u/P- 



3. Marginal polytope 

In this section we consider the (^-exponential family of Eq. ([1]) together 
with its non-parametric presentation, where we have a vector space of p- 
centered random variables and the statistical model of Eq. (|2]). The random 
variables Hj — Ep[Hj], j = l,...,m, span the space V C Lq{p) and the 
relation beween the two parameterization 6 E and u E V are shown 
in Q. The marginal polytope of the 0-model (also called convex support) 
is the convex hull M of the set {H{x) : x E X} C R"", H = {Hi, . . . , Hm). 
The function a: M™" — )■ M is convex and has a convex conjugate a*{ri) = 
sup{e-r]-a{e): 6 E M™}. 

The follow ing theorem is the deformed version of classical results e.g, 
terownl. [l9 8 p. Th . 3.6). We use notions of convex analysis to be found in 
Rockafellaj fll970l ). 



Theorem 1. 1. The convex conjugate a* : M"^ — t- MU {+00} of a is finite 
exactly on the marginal polytope M = co (imif). 
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2. The gradient mapping Va: MJ^ — )■ MJ^ is onto the interior M° of the 
marginal polytope M. 

3. a* restricted to M° is the Legendre transform of a that is, a*{rj) — 
9-ri-a{9) if = E^,^ [H]. 

Proof. 1. Assume first r] G M, namely rj = y^{x)H{x), \{x) > 0, 
J2x -^(^) ~ ^^'^ H{x) = {Hi{x), . . . , Hm{x)). From the convexity of 
the exp^ function, we obtain 

exp^ {0-r)- a{e)) = exp^ X{x) {9 ■ H{x) - a{9))^ < 

Y,\{x)e^V^{9-H{x)-a{9)) 

X 

As ii{x) > 0, a; e A', C = max^. A(a;)//x(a;) is finite and \{x) < CiJ,{x), 
therefore 

exp,^ {9-rj- a{9)) < C ^ f,{x) exp^ {9 ■ H{x) - a{9)) = C, 

X 

so that 9-r]- a{9) < In^ (C) for all 9. 

Assume now t] ^ M. As M = co {T{x) : a; G A") is a compact convex 
set, 7] is strictly separated from M, that is, there exist an afiine function 
t ^ a • t — ao, a = (ai, . . . , am), such that a ■ H{x) < gq, x G X, and 
a ■ T] — qq + 1. Along the sequence 9n — na, n — 1,2, . . . , we have 

1 = 5^ exp^ {9n ■H{x)- a{9n)) n{x) < exp^ (noo - a{9n)) , 

X 

SO that 

< nao - a{9n) = 9n - r] - n - a{9n), 

which in turn implies 9n ■ r] — a{9n) — > +oo as n — > oo. 
2. Each 1] = Vip(9) is of is an expected value with respect to the escort 
density, r] = E<^^6i [H] , therefore 77 e M° because the escort density 
is strictly positive. Viceversa, if 77 e M° , let us assume first that the 
elements of H are linearly independent so that the convex set M is solid. 
In such a case, there exists a positive constant e > such that r] + eu E 
M° for all unit vector u. Consider a tangent hyperplane T^iy) = 
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of the e-ball centered at r], orthogonal to u, Tu{y) = u • {y — rf) — e. 
It follows that T{rj) = — e < and moreover there exists at least one 
Xu & X such that T{H{xu)) > 0, that is 9- {H{xu) — rj) > pe for 6 = pu, 
p e M. We have 

1 = ^ exp^ {9 ■ H{x) - a{9)) > exp^ {9 ■ H{xu) - a{9)) 
hence 

In,^ ( ) > ^ ■ H{xu) - a{9) > 9 ■ r] + pe - a{9). 

therefore, for p — )• +oo, 

9 ■ 1] — a{9) < —pe — t- — oo. 

The maximum of i— )■ 9 ■ rj — a{9) is reached at some point 9 that 
satisfies t] = Va{9). 

The general case is obtained by considering a linear independent subset 
of Hj and expressing the marginal polytope as an affine function of the 
reduced marginal polytope. 
3. From the convexity of a it follows 

a{9) - a{9) > Va{9) ■ [9 - 9) = t] ■ [9 - 9). 

By rearranging the terms, 

r]-9-a{9) >r]-9-a{9), 

therefore, a*{ri) = rj ■ 9 — a{ri). 

□ 

The non parametric version of item [T] of Th. [T] follows. We are not 
discussing here the other two items. 

Theorem 2. The convex conjugate Hy of K is finite at u* if, and only if, 
{u* + l)p is a density, that is Ep [u*] = 0, u* + 1 > 0. 
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Proof. From Eq. (I3D we have for u ^ V 



Ep [u*u] - K{u) = J2 ^jEp [u*{Hj - Ep [Hj])] - a{9) + ^ OjEp [Hj 



= ^^,E,[(«* + l)if,]-a(0) 

where rjj = Ep [{u* + l)Hj], j = 1, . . . , m. For such a r/ we have Hy{u*) = 
supff^r] ■ 9 — a{9)) which is finite if r/ G M. As rj = '^^{u*{x) + l)H{x)p{x), 
{u* + l)p must be a density. □ 



4. Discussion 

We have shown in Th. [T]that the basic properties of the marginal polytope 
carry over from the classical case to the deformed case. Moreover, we have 
provided in Th. [2] a non parametric definition of the marginal polytope. 
This should be relevant in the discussion of the variational properties of the 
related deformed entropies. The results are restricted to the case of finite 
state space, while the non parametric l angua ge prompts for a generalization 
in the direction of iPistone and Sempil ( 119951 ). 



A new general non parametric approach has been used in lVigelis and Cavalcante 



( I2OIII ) to ease the discussion of the dependence of the chart from the reference 
density p. Each density q is represented as exp^ {u — K\c{u) + luj^p) with 
respect to /i, u G Lo{fi). In such a case we have In^ q = u — K\c{u) + ln<^p, 

that is Kyc{u) = E^ [In^p — In^g] instead of K{u) = E^ In^ 



References 
References 

Brown, L. D., 1986. Fundamentals of statistical exponential families with ap- 
plications in statistical decision theory. Institute of Mathematical Statis- 
tics, Hayward, CA. 

Kaniadakis, G., 2001. Non-linear kinetics underlying generalized statistics. 
Physica A 296 (3-4), 405-425. 



8 



Naudts, J., 2011. Generalised Thermostatistics. Springer. 



Ohara, A., Amari, S., 2011. Geometry of g-exponential family of probability 
distributions. Entropy 13 (6), 1170-1185. 

Pistone, G., 2009. ^-exponential models from the geometrical viewpoint. The 
European Physical Journal B Condensed Matter Physics 71 (1), 29-37. 

Pistone, G., Sempi, C., 1995. An infinite-dimensional geometric structure on 
the space of all the probability measures equivalent to a given one. Ann. 
Statist. 23 (5), 1543-1561. 

Rockafellar, R. T., 1970. Convex analysis. Princeton Mathematical Series, 
No. 28. Princeton University Press, Princeton, N.J. 

Vigelis, R. F., Cavalcante, C. C, 2011. On the 0-family of probability distri- 
butions, |http://arxiv.org/abs/1105. lllSj 



9 



